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Abstract 

o ■ 

^\j ■ We present a relation between sparsity and non-Euclidean isomorphic embed- 



^ 



dings. We introduce a general restricted isomorphism property and show how it 
enables to construct embeddings of ip, p > 0, into various type of Banach or quasi- 
"^ ■ Banach spaces. In particular, for < r < p < 2 with r < 1, we construct a family 

fl I 7i)n 

^,, of operators that embed .« into .. , w.th optmral polynomial bounds m . > 0. 

"S '. 1 Introduction 

A quasi-Banach space (X, || ■ ||) is said to be an r-normed quasi-Banach space for some 
< r < 1 if: ||x|| = iff x = 0, ||Ax|| = |A|||x|| for any x G X, A G M, and for 
^ ! any x, y E X, \\x + y]]"^ < \\x\\^ + WyW^- It is well-known [23j that any quasi-Banach 

0\ . space can be equipped with an equivalent r-norm for a certain r G (0, 1]. We denote by 

Q ■ sparse(m) = {x G M" : |supp(x)| < m} the set of vectors in R" of cardinality of the 

t^^ ■ support smaller than m. For r-normed quasi-Banach spaces {Ei, \\ ■ ||sj and (£"2, || • IU2) 

and for p > 0, we define two properties of operators from i^ into Ej, j = 1, 2, which play 



X 



an important role in this paper. 

We say that an operator A : i^ -^ Ei satisfies property Vi{m) if 



c^ ' Vx G sparse(m) Q;|x|p < ||ylx||£;^ < /3|x|p 

where \x\p = {Yl'i=i \^i\^) • This property is a generalization of the Restricted Isometry 
Property of order 6 introduced in [5], for the Euclidean case, that is, p = 2, Ei = £2, and 
the isometry refers to the fact that 36 G (0, 1) such that a = 1 — 6 and /3 = 1 + 6. We 
call property Vi{m) the restricted isomorphism property. In the case p = 2, some other 
versions of this property have been considered in the literature P, HU], introducing the 
relevance of working with general a, (3 and also with Ei being i^ instead of a Euclidean 
space. Here we introduce a general setting that is useful when a quasi-Banach space Ei 
has stable type p (see Section H] for the definition). The main difficulty is to find operators 
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that satisfy property Viirn) for a large m, and /3/a being universal constant. To do so, we 
use random methods going back to [HI [22]. For example, let < r < p < 2 with r < 1, 
and let Ei be ^J?" with r] G (0, 1], we exhibit families of random operators T : £" — )■ £J?" 
that satisfy property Vi{m), with overwhelming probability, for 

m = Cp^r 7 N- n [l) 



log (l + ^ 



where Cp,,- and /3/q; are constants depending on p and r. It works also in a more general 
setting of quasi-Banach spaces of stable type p. 

For the second property we need the following notation. Let a; G M" and let ip^ '■ 
[n] — )■ [n] be a bijective mapping associated to a non- increasing rearrangement of (|a;j|), 
i.e. |x<^(i)| > |x^(2)| > ■■■ > \x^{n)\- Denote by Jfc = ipj,{{{k - l)m + 1, . . . ,km}) the 
subset of indices of the fc*'^ largest block of m coordinates of (|xj|), for 1 < A; < M, where 
M = [^] < ^ + 1 (note that Im may be of cardinality less than m). We denote by x/^. 
the restriction of x to Ik- Clearly, xi^ G sparse (?7i) for 1 < fc < M and 



M 
X = 

k=l 



E^^^ (2) 



as a disjoint sum. 

We say that an operator B : i^ ^ E2 satisfies property V2{K,m) if 

l/r 



^ fc>2 ^ 



1/g I I 



where ^ + ^ = i. This property with the right choice of parameters is just a simple 
consequence of linear algebra, it asks about finding a nice family of vectors in E2. Our 
main simple example is that -^J^ : PI ^ P^ satisfies property 7^2(1/^, rn). This is inspired 



m 



by the techniques used in compressed sensing theory, see for example [Hll]. 

Now, we present our main theorem, it is a deterministic statement about Kashin-type 
isomorphic embedding for operators that satisfy properties Vi{m),V2{n, m). It provides a 
new framework for constructing operators from £" into the quasi-Banach space Ei ©1 E2, 
equipped with the quasi-norm ||x|| = H^iH^;^ + ||x2||_b2) where x is uniquely defined by 
Xi + X2, Xi G El, X2 G E2. 



Theorem 1 Let < r < p < 00, with r < 1, and let Ei, E2 be r-normed quasi-Banach 
spaces. Let A : i^ ^ Ei be an operator that satisfies property Vi{m), and let B : i^ -^ E2 

^('-^V^'A andV = r^- 



be an operator that satisfies property V2{k, m). Denote U = \ (■^) A and V = -, — ttj^B. 



Then for any x G 



u^ I Oi\ /min(m, l/fi;)\ , , ,_^ ,, ,_^ ,, , , 



where - + - 

P Q 



As we said, we know several important situations, where we can find operators that 
satisfy the main properties. Let 77 G (0, 1] and Y be the random vector taking the values 
{±ei, . . . , ±e^„}, the vectors of the canonical basis in M^", with probability j^. Let (Yij) 
be a sequence of independent copies of Y, where 1 < i < n, j eN. We define the operator 
(see [sang) 

n ^ 

X = [Xi, . . . , Xn) t-> 2_^ ^i 2-^ 'jT/p "^J ^"^^ 

We shall prove in Section H] that a certain multiple of 5* satisfies property Vi (m) with 
m as in ([T]). An important consequence of Theorem [T] is the following: 

Theorem 2 Let < r < p < 2 with r < 1. For any rj G (0, 1] and any natural number 
n, let W be a {1 + ri)n X n matrix defined by 

Ty = 4r I ^'^-^ h C ^ 4'"*"'^" 
nVg y S J " 

where S = -r-. — TTTTjynj^S. Then, with probability greater than 1 — 2exp(— fep^f-r^n), for any 

X gM" 

1/9 

\x\p < \Wx\r <3-2^/''|a;|p 
where - + - = ^, and c'{p, r), bp^r, Cp^r are positive constants depending on p, r. 

This answers a long standing question, whether one can give an explicit construction 
of random operator that embeds tl into £^, where < r < p < 2, with r < 1, and 
A^ = (1 + vi)n, rj G (0,1], with optimal polynomial bound in 77 (up to a log factor). 
This question was solved recently in [12], where the isomorphism constant is Cp\r ^ using 
a full random operator (similar to the operator S). The improvement here comes from 
a reduction of the level of randomness of the operator. In a sense, it is a mixture of 
deterministic and random methods, which enable us to reach the best bound in the 
isomorphism constant. Several previous works [HI [221 El Ell [13 [12] dealt with this 
subject. We refer to [151 112] for more precise references. An important remark is that 
the conclusion of Theorem [2] holds for a lot of new operators. For example the random 
operators defined originally in [13] also satisfy property Pi{m) with the same m as in 
([T|). And several other operators 5 : £p — )• £" satisfy property V2{l/m,m). Hence, the 
strategy that we have developed allows to define several new explicit random operators 
that satisfy the desired conclusion. 

The paper is organized as follows. In Section [21 we present the main consequence of the 
properties Vi and V2, that is. Theorem [H Of course, the delicate point is to describe some 
operators that satisfy the properties Vi{m) and V2{n, m) with the good parameters. This 




is the purpose of Corollary H] in Section |3] and Theorem [5] in Section HI In Section |5l we 
present the proof of Theorem [2l Finally, in the Appendix, we discuss the consequences of 
property Vi (m) in approximation theory and compressed sensing as it is now understood 
after the papers [8], [5], [1] and [17] (see e.g. Chapter 2 in [6]). In particular, we observe 
that these operators are good sensing matrices when using the ^r-niinimization method 
and that the kernel of these operators attain the optimal known bounds for the Gelfand 
numbers of Id :£"—)■ £!J. This illustrates the tightness of the method. 



2 The main theorem 

In this section, we prove Theorem [T] Let x G W^ and decompose it as it is described 
in the introduction, see ([2]): x = J2k=i^h' where {Ikj^Li i^ the subset of indices of the 
^th laj-ggg^ block of m coordinates of (|xj|), and xj^ is the restriction of x to Ik- Each 
subsets Ik is of cardinality m except Im whose cardinality is less than m. Moreover, 

M =\^'\< ^ + 1. 

I m I — m 

Let us start with the upper bound. By the triangle inequality, definition of U and 
property Vi{m), we get that 

MM , M 

k=l k=l k=l 



M / M 



r/p 



Since r < p we get by Holder's inequality 

M 
fe=l \A:=1 

where 1/p + 1/q = 1/r. By definition of the ^"-norm and of decomposition (|2]) of x, 

M 

\P — \^ It, IP 



J] 1^4 1 



fe=l 



and we get that ||?7(x)||£;^ < 2 |x|p. By definition of V and property V2{ti,m), we have 
II^^^IIe^j < l^^lp- We conclude that for any x G M", 

llf^a^lUi + ||^a^||£'2 ^ 3|x|p 

As for the lower bound, we partition the sphere S"^^ into two sets, such that on one 
set we have a lower bound for ||[/x||£;j, and on the other set we have a lower bound for 
II Vx||e2- This natural type of partitioning of the sphere was also used by Kashin [IB] and 
PH H]. More precisely, for < 7 < 1 to be defined later, we partition the sphere Sp~^ 
with respect to 7 and define 

j:^ = {x e s;-' : \\Vx\\e,<i} 



Clearly by this definition, if x ^ S^ then a lower bound 7 holds for this point, i.e. 

||yx||£;2 > 7 

In the other case, where a; G S^, we shall obtain a lower bound, this time for the operator 
U. By the triangle inequality 

Now, we learn each term. By decomposition ([2]) of x, triangle inequality, and property 
Pi(m) 

MM , M 






r 



l^^^^ll^i^ U Ur l^^^ip 



For < r < p < 00, with r < 1, the £p-norm on M" is an r-norm. Hence 

M M 

fc=2 fc=2 

Therefore, 



r I I M 



i^^'.ii-M|j (7) (i-gi^'*'^ 



Combining all the above, and since P/a > 1 



^'^^ \ fc=2 / fc=2 






(-£'-K-(01) 



By property V2{K,,Tn) and recalling that x G S-^ we have 

M 
k=2 

It follows 



i-«^.>-(i)'©""0-^^'>«r"(!)l 



We conclude that if 

7 



a / 1 ^ '^ 



5 



then for any x G S^ 

Recalling that for any a; ^ E^ we have ||V"x||s2 > 7, it implies that for any x G 5*"^^ 

a f minim, 1/k)\ ''^ ,_^ ,, ,_^ ,, 



41A/3 V n 

Combining with the upper bound, it concludes the proof of Theorem [1] ■ 

3 Operators satisfying property V2{i^^^ 

Property V2{K,,m) can be satisfied by many operators, probably the most natural exam- 
ple would be the identity operator. This is just a simple consequence of the following 
elementary lemma about the partitioning scheme that we described above. 

Lemma 3 Let < r < p and let x G M" 6e decomposed as in (^. Then for any j > 1 

2_^ F4+ilp I < ^^F(/iu...u7,_i)Hr < :^^mr 
k=j / 

where a is defined by - + - = -. 

1 J '^ p q r 

Proof. Let A; > L We have 

F4+ilp = Z^ Fil < \h+i\ '^ ■ max \xi\ 



and 



1 . 1 

max IxiT' < min IxA^ < —— > IxA^ = t^-tIx/, I!! 



We deduce 

I /" l*"/^ 1 

Vfc > 1 \xi \< — — - — x/J^ < — -7- x/J^ 

Summing up these inequalities for all k > j we get 

M-l J\/-l 

k=j k=j 

which concludes the proof. ■ 

It follows that the identity operator from £p to £J!, correctly normalized, satisfies 
property P2{l/m,ni). 



r 



Corollary 4 Let < r < p < oo and q be such that 1/p + 1/q = 1/r. The operator 
^^^Id„ : £p — )■ £" satisfies property V2{K,m), where i^ = ^ and E2 = £". More precisely 
for any x G M", 

\x, r < Id x r < 1 — 1 Lr r 

k=2 

Proof. Take j = 1 in the Lemma [3] and use Holder's inequality for the upper bound. ■ 

Remark. 1. Property V2{ — ,rn) holds true for matrices with non-trivial kernel, e.g. take 

a permutation matrix Per (where a G Sn) and remove k (up to m) rows. 

2. Property V2{^,m) holds true for any operator ■:^^^V, where V : ip ^ E2 satisfies for 

any x G M" 

|a;|r. < \\Vx\\e2 < {KnY^'^lxlp 

4 Operators satisfying property Vi(rn) 

In order to apply Theorem [1] we should find operators that satisfy property Vi{m). For 
p = 2, the set of matrices that satisfy property Vi{m) is wide. Indeed, random matrices 
like e.g. Bernoulli matrices, Gaussian matrices, matrices with independent log-concave 
rows, satisfy this property for a large m with Ei = l^ o^ ^i- I^ the case p 7^ 2, the 
situation is more delicate. We shall present a possible answer when < p < 2, which is 
based on the notion of p-stable random variables. A natural question consists of asking 
what happens for p > 2. In that case, our method won't work, as the notion of p-stable 
random variable is not valid anymore. 

4.1 Restricted isometry property for quasi-Banach spaces 

We need several consequences of well-known results about p-stable random variables. We 
refer the reader to Chapter 5 of the book [12] and to [221 E] for the construction of the 
random operator that we present here. We recall that a real- valued symmetric random 
variable is called p-stable for p G (0, 2] if its characteristic function is as follows: for some 
0" > 0, Eexp(it6') = exp(— cr|t|'P), for any real t. When a = 1, we say that 9 is standard. 
Stable random variables are characterized by their fundamental "stability" property: if 
{6i) is a standard p-stable sequence, for any finite sequence (a^) of real numbers, ^^ aiOi 
has the same distribution as (^^ |q;j|''^)^''^^i. 

Let < r < p < 2, with r < 1, and let X be an r-normed quasi-Banach space. We say 
that X is of stable type p if there exists a constant STp such that for any finite sequence 
{Xi)i C X 



(eiiE" 



:Hir l"''<STp(J]||iir)"'' (4) 



where {9i)i is an i.i.d sequence of standard p-stable random variables. We denote by 
STp(X) the smallest constant STp, such that @ holds. An important property of p- 
stable random variables is the following stability result. Let = Xl^i ^j^jy where Xj G X 
and 6j are i.i.d. p-stable random variables. For every integer fc > 1, if Bi, . . . , G^ are 
independent copies of then for every (aj)^=i G M^, J2i=i Q^jQj has the same distribution 
as iJ2i=i \c(i\^Y^^Q. In particular, 

k \ i/^f- k 

E|l5^«.e.ir =($^|a.n^/^ (ElieiD^/^ (5) 

Assume that X is of stable type p with < r < p < 2. Therefore, we can find a finite 
sequence Xi, . . . ,xiy E X such that J2i=i W^iV = 1; ^^^ 



/ N \''' I 



l/r 

(6) 



Let t/i = Xi/\\xi\\. Let F be a symmetric X- valued random vector with distribution equal 
to J2i=i W^iVi^Vi +'^-j/J/2, and let Yi, Y2, . . . be i.i.d copies of Y. Let (Aj) be independent 
random variables with common exponential distribution P{Aj > t} = exp(— t), t > 0. Set 
Tj = ^11=1 -^«5 f*^^ J ^ 1 then it is known (cf. [19]) that there exists a positive constant s' 
depending on p, such that in distribution 

N 



It follows that 



l/r 



(E||0|r') ''>Sp-STp(X) (7) 

Following Pisier [22], we define the operator 



T : £; ^ X 



1 " 

n)->7 ^E«^Er^^'^^.- (8) 

Eiieii'-) i=i i>i 



O \Oii, . . . , Clny ' ' , - 1/ 



Theorem 5 Let < -^ < r < p < 2, wt/i r < 1, and let X be an r-normed quasi- 
Banach space, with stable type p constant STp(X). Then with probability greater than 
1 — 2exp {—bp^r (STp(X))'') the operator T satisfies property Vi{m) for any m, such that 

m < {cp,rSTp{X)y / log{l + n/{cp,rSTp{X)y) 

where - + - = - and bp^ri Cp^r o,i"g positive constants depending on p and r. More precisely, 

for such m 

1 3 

Va G sparse(m) - \a\p < \\Ta\\^ < -\a\p 



Remark. 

1. For any 6 G (0, 1), we can introduce a dependence in S in the choice of m, such that 
property Vi{m) holds with a = 1 — 5 and (5 = 1 + 5. So, this is an extension of the RIP 
to r-normed quasi-Banach spaces. 

2. Notice that ([6j) is the main property that should be satisfied by the family of vectors 
{xi, . . . , xn} C X. The quantity STp(X) in the theorem can be replaced by the quantity 
that will appear in this inequality, for the prescribed family {xi, . . . , x^}. It is not nec- 
essary to estimate STp(X) but the definition of stable type p corresponds to make it as 
large as possible. 

For the proof of Theorem [5], we define the following auxiliary operator 



a = («!, . . . ,a. 



n 

Eiiei 



i=i j>i 



We need the following two lemmas, which are analogous to the main lemmas in [2^ [2] . 
The first one is a consequence of well-known results about p-stable random variables (see 
also [21 Lemma 0.3]). 

Lemma 6 Let < -^ < r < p < 2. For the operators T and T defined above, there 
exists a positive constant dp^r depending on p and r, such that for any a G M", 

E||Tair-E||fa|i^ 



dp^r v^i .^ ^ dp^r Isnppia)]''/" 
< — > laA < = 



Eiiei 



i=l 



Eiiei 



Proof. It is known (see [12] for details) that for any < —^ < r < p < 2 there exists a 
positive constant dp r depending on p and r, such that 



^eIj-i/p-fti/p 



< d. 



'p,r 



Therefore, 

E||Tair-E||t«| 



< 



Eiiei 



-E 



i£snpp{a) j>l 



~ EiieiK ^^^ 

" " iGsupp(a) 



E (r^-i-u - r-'"y, 



< 



Eiie 



' j: NrEE|r-''-r, 



1/p 



iGsupp(a) j>l 



\Yi 



t]\ 



~ Eiieii^ ^^ ~ 

" " iGsupp{Q) 



dp^r |supp(q;' 

EiieiK 



\r/q 



The next lemma follows from results about scalar martingale difference (cf. [T ^ [22 | [2]). 

Lemma 7 Let X be an r-normed quasi-Banach space and {Zj)j be a sequence of inde- 
pendent X valued random vectors, which are uniformly bounded. Let Xk = ess sup ||Zk(-)||. 
If Z = J2k>i ^fc converges a.s. then for any t > we have 

P{|||Zf -E||Z|n >t}<2expl -c', ' 



^'''' II (AI 



^kJk\\p/r,oo 

where c' is a positive constant depending on p and r. 



Denote Zk = aij^^^^Yij and observe that \\Zk\\ < \ai\j'^^^. It is easy (cf. [22| [12]) to 
deduce that ||(A^)fc||p/r,oo < |«|p = 1- Therefore, by applying Lemma [TJ for any t > 0, we 
obtain 

p||||Ta|r-E||Ta|r| > —L-\ < 2exp(-c',t''h 

I ~ Eiieii'^J ~ '^' 

Taking t = s^' E||6||'', we conclude that for any a G 5'^^"'^, 

P{|||Ta|f'- -E||ra||r > s''} < 2exp (-c'^rS" (E\\e\\'y^'^ (9) 

Proof of Theorem [51 Let a G 5*""^. By ([5]), and the discussion above we have 

Eiitair = ^^E|| y a,y r7'/%ir = ^^eh y a,e,r = ^St = i 

Eiieii- "^ 4:^ ' '" E||0||- "^ " Eiier 
II II j=i j>i II II j=i II II 

Therefore, by Lemma [H] 

dp^r\snp'p{a)\^^'^ 



E Tar -1 



EWTar -E\\Ta\ 

q/r 



< 



Eiieii^' 



It follows that if |supp(a;)| < ( J^^ " j then 



|E||T«|r"-i| < - 

~ 4 



Moreover, by Q for s = (1/8)^/'' 

P{|||Ta||"-E||Taf| > 1/8} < 2exp f-fe^^, ('EUGf V J 

We deduce that for every a G 5*"""^, such that |supp(a;)| < 



Eiieir "> '^'^ 



P{5/8 < ||Ta|r < 11/8} > 1 -2exp (-6;^, (EUGirV^ j 

We need to approximate the set of sparse vectors of size m of 5"^^ by a net. By a 5-net 
of a subset U of an r-normed space X, we mean a subset Af of U, such that for all x G t/, 

inf \\x — yV < 6 

yeAf 

10 



It is well-known by a volumetric argument (see p^ Lemma 2] ) that if X is an r-normed 
space of dimension m then the unit sphere of X contains a 6-net of cardinality at most 
(1 + 2/(5)™/^ Now, since 

sparse(m) n S'^'^ = |J M^ H 5^^^ 

\I\=m 

we can find a 1/12-net Af of sparse(m) fl 5'^""'^ of the form U\i\=mJ^i, where A/} is a subset 
of R^ n S^-^ of cardinality at most 25™/^ The cardinality of Af is at most (J^)25™/^ < 
exp(mlog((ir^7i/n)), where dr is a constant depending on r. From a classical union bound 
argument, we deduce that with probability greater than 

1 _ 2exp f-b'^^^, (Elier)'^' + mlog (^)) 

we have 

Vi/GA/-, 5/8 < llTyir < 11/8 

Since for any a G sparse (m) fl 5*^"^ there exists y G Af, such that a — y E sparse (m) 
and \a — yYp < 1/12. And, for r < p, the £p-norm is an r-norm. We get by the triangle 
inequality of the r-norm || ■ || 

Va G sparse(m) n S^'^ UTaf > \\Ty\\' - \\T{a - y)\\'~ 
and sup ll^^ir < sup ||Ty||^ + — sup ll^ctlT 

It is easy to conclude that with probability greater than 

1 _ 2exp ("-6;,, (Elieir)'^' + mlog (^)) 

we have 

Va G sparse(m) n S!^~\ 1/2 < ||Ta|r < 3/2 

By (jTj) we know that 

(Elieil") ' > SpSTp(X) 

and we conclude that for constants bp^r and Cp^r depending on p and r, if 

m < {cp,rSTp{X)y I log (1 + n/(cp,,STp(X))^) 
then 

P{Va G sparse(m) n 5;"\ 1/2 < ||Ta|r < 3/2} > 1 - 2exp(-6p,, (STp(X))'') 
This ends the proof. ■ 
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4.2 Restricted isomorphism property for i^ 

Let < r < p < 2 with r < 1, let r^ G (0, 1] and X = £J?". It's well-known that 
STp(£^") = c' {'qnY^'^. It's easy to see from definition (jl]) that we may take the canonical 
basis of R''" as the Xj's in ([6j). Hence, let Y be the random vector taking the values 
{±ei, . . . , ±e,,„}, the vectors of the canonical basis in W^, with probability y^. We 
define the operator (see also [12]) 



n ^ 

X [Xi, • • • , Xn) I 7- ^ ^ Xi y ^ 'l/m *. 



i=l i>l -^ 
We deduce from Theorem [5] the following important corollary. 

Corollary 8 Let < r < p < 2, wt/i r < 1. Let r] G (0, 1] and b = Cp^r-r^/ log(l + l/r]). 
Then with probability greater than 1 — 2exp(— 6p^,,?7n), the operator S/{r]nY^'' satisfies 
property Vi{6n) . More precisely, 

Vx G sparse(5n) c(p,r)|x|p < - — --rl'S'x|r. < C{p,r)\x\p 

where Cp^riC{p.,r),C{p,r) and bpr are positive constants depending on p andr. 

Proof. It is important to note that the definition of S does not depend on the choice of 
r. Let r G (0, 1]. If < -^ < r < p < 2, this is a direct application of Theorem [5] and the 
fact that STp(£J?"') = Cpj.{'r]nY^''. For the other values of r, we use a classical extrapolation 
trick. Let ri < 1 and r2 < 1 be such that < —^ < ri < r2 < p < 2 then we can use the 
first case and deduce that with probability greater than 1 — Aexp^—bprjn) 

( 1 

ci{p)\a\p < 7Z;^TT7^l'^"ln < Ci{p)\a\p 



Va G sparse((5n) < 



C2(p)|a|p < -—Tj^^\Sa\r., < C2ip)\a\ 



where - + — = —, - + — = — and bp = min(6p,.j, &p,r2)- Fo^' ^W r < ri, we have for any 
z G M''", |4n < klrklra"^ ^here l/n = ^/r + (1 - 0)/r2, and |z|^ < {riny/'-^/''^\z\r,. It 
is easy to deduce from the previous inequalities that 

Va G sparse(5ri), c(p)^'^' \a\p < - — -j^lS'alr < Ci{p) \a\p 

for a new positive number c{p) depending on p. m 

Remark. We should add that the random operator defined in [H] also satisfy the same 
property Vi{m), since the main properties of this random operator are completely anal- 
ogous to Lemmas E] and [71 

12 



5 Random embedding of tl into l^ 

In this section, we describe the main consequences of properties Vi and V2 in the geometry 
of Banach spaces. We prove Theorem [2], about the existence of very tight embeddings 
from £" into tr ^ , where t] is an arbitrary small number, and < r < j9 < 2 with r < 1. 
The isomorphism constant of these operators is of the order of (77/ log(l + l/r]))^^^'^, where 
1/p + 1/q = 1/r. Up to the logarithmic term it is best possible since the Banach Mazur 
distance between £" and i^~^^ is of the order n^^'^. It improves the main result of [12] and 
we refer to this paper and to |T5] for the history of the problem. 



Let S -.i"^^ £;?" be the operator defined in (^ and W : i"^ ^ £^^'^''^" be defined by 

nV? y s J '' 

where S = Tiwfrf/ynTi-'S' and c'{p, r) is a constant depending on p and r. By Corollary [HI 
with probability greater than 1 — 2exp(— fep^^r^n), the operator S/{'r]nY^'^ satisfies property 
Vi{Sn), that is 



1 



Vx G sparse((5n) c{p,r)\x\p < - — "y^I^xIj. < C{p,r)\x 



{riny/' 



IP 



where 6 = Cp,r^/log(l + l/rj) and bp^r,Cp^r,c{p,r),C{p,r) are numbers depending on p 
and r. Moreover, by Corollary HI the operator ,^J.i/q Idn : £p — )■ £" satisfies property 
V2{l/Sn,6n). Therefore, by Theorem [T|, we conclude that, for any x G M" 



4-V' 



i/r c(p, r) 



C{p,r) llog(l + i 




for n nZi/\M/a S = S. Since 



1/r 



\x\r + \Sx\r < (\X\; + ISxll) ' = U^^^lVVxlr < l^'" (\x\r + \Sx\, 

the proof of Theorem [2] is complete. ■ 

Appendix 

We would like to conclude this paper by presenting some relations between property V\ 
and between approximation theory and compressed sensing. Indeed, in his seminal paper 
[B] , Donoho made several connections between compressed sensing and Gelfand numbers. 
We pursue that direction and present direct consequences of property V\ in this setting, 
like in [HI O [TOl [TT]. The results are known. The main point is to emphasize about new 
subspaces that "attain" Gelfand widhts, and new operators that satisfy the approximate 
reconstruction property via the ^^-minimization method, for < r < 1. 
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Recall that the Gelfand numbers of an operator u : X ^ Y is defined for every A; G N 
by 

Ck{u : X -^ Y) = inf{ sup ||'u(x)||y} 

x&S,\\x\\x<l 

where the infimum runs over all subspaces S of codimension striclty less than k. For any 
< r < oo, we define the weak-£" space to be M" equipped with the quasi- norm | ■ |j.oo 



Vx G 



■^ T* OO ma-A. 6 -lyj 

i=l,...,n 



where xl > X2> ■ ■ ■ > x^ is the non- increasing rearrangement of (|xj|)"^]^. 

Proposition 9 Let Ei be an r-normed quasi-Banach space, A : i^ -^ Ei with < r < p 
and m < n, such that property Vi (m) holds true. Then 



V/i G ker A, \h\p < (1 + (/3/af )'/^ I J^ \h 



M \ V*^ 

k Ip 



(10) 



,fc=2 



where h = Ylk=i ^h ^^ ^^^ decomposition defined in (0) and M = [— ] . Let s < m then 

V/iGkerAV/C {l,...,n},|/| <s, \hi\r < ( -Y \l + {f3/ayy^'' \h\r (11) 

Remark. The conclusion of the proposition does not depend on the choice of Ei. It is 
chosen such that the property Vi (m) holds true for a value of m as large as possible. 
Proof. Let h G ker A, h ^ and write 



\h\l=\h-hjX+\hiAl 



Since r < p, the first term satisfies 



I /i — /i/ J 



M 



fc=2 



M 



E I"- 



l/P / M \ ^/r 



,k=2 / \fe=2 

For the second term, we use property Viijn). Since h G ker A then A{hi^) = — X]fc=2 ^i^h] 
and since hj-^ G sparse (m) we get by property Viijn) 



\hiAp<-U{hj,)\\E, = - 
a a 



k=2 



?i \k=2 / 



where the last inequality comes from the triangle inequality for the quasi-norm in Ei. 
Since for any k >2, hj^ & sparse (m), we have by property Vi{m), for any k >2 

Combining both terms, It is easy to deduce flTOj) . If /i G ker A and / C {1, . . . ,n} with 
|/| < s, we have by Holder and flTOj) 

\hi\r< s^/^I/^Ip < s'/^ (1 + iP/aff'' ( E 1^^^ Ip ) 
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From Lemma [3], we conclude that 

\hi\r<(-y^\l + {P/arf'\h\ 



The argument that we have presented goes back to [Hj while working in a Euclidean 
setting. We refer also to |6] for more details. Inequality (ITO|) has some obvious conse- 
quences in terms of Gelfand numbers of the identity operator between some sequence 
spaces that are known from [TT]. Inequality fill I) is a strong form of the so called null 
space property and has consequences in compressed sensing. 

Corollary 10 Let < r < p < 2 with r < 1. Then for any Cp^r^ogn < k < n — 1, 

c,(Id : C ^ ^p) < c.(Id : Coo ^ C) < Cp,r (^V^^J ^^^^ 

where l/p+ 1/q = 1/r, and Cp^^iCp^r fl'"^ positive constants depending onp,r. 

The upper bound in flT^ is known to be optimal [TT] (up to constants depending on 
p and r), it is proved by interpolation in [13] (see also [25]). Here, we give an alternative 
proof based on our method, i.e. we find new subspaces for which this bound is attained. 

Proof. For any x G M", |a;|r,oo < \x\r- Hence, the left inequality is obvious. Let 
Cp^r^ogn < k < n ~ 1 and Ei = £^^, where r < ri < p and ri < 1. Let rj such 
that k = r]n, we know from Corollary [S] that S/k^^^^~^^P satisfies property Vi{m), where 
'^ = Cp,rik/ \og{l + n/k), a and (3 being constants depending on p and ri. Following the 
proof of Lemma [31 we know that for any h G M", 



m 



Iq r-|r,oo 



by definition of the weak-^ norm. Since ri/r > 1, Xlfc>i ^ ^^^^ i^ finite and 

El"'.!? <-^,\M':-^ 

By definition of S, codim ker S < k and we conclude by Proposition M and (ITU]) that 

for any h G kei b, \n\p < Cp^r I r — j \h\r,oo 

which ends the proof. ■ 

Remark. Obviously, for r = 1, we get with the same proof an additional log(l + n/k) 
factor as in [TT]. 
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There is a connection with the analysis of sparse recovery via £r-niininiization method 
for < r < 1. Let S : R" ^ M^' and for any ye™" 



5 



Ar{y) = argmin \z\r, subject to Sz = Sy (13) 

For r = 1, this is the basis pursuit algorithm [1], and it has been generalized to the 
non-convex minimization problem for r < 1 in [Zlinilll]. It is known [llj that if a matrix 
satisfies the Restricted Isometry Property then the ^^-niininiization method gives good 
approximate reconstruction of signals (which is exact in the sparse case). Since inequality 
flTTl) is the analogue of the strong form of the so called null space property in compressed 
sensing, we conclude that an operator satisfying property Vi{m) for some quasi-Banach 
space El is a good sensing matrix. We illustrate it in the following corollary. 



Corollary 11 Let S : P^ ^ d^ be the random operator defined in ^. If s > satisfies 

then with probability greater than 1 — exp{—bprk), 

|7/-A,(y)|^,<4V-inf \y-yj\r 

And if y E sparse(s), the reconstruction is exact: y = Ar{y). 

Proof. By definition of A,,, h = y — Ar{y) G ker S and \Ar{y)\r < \Ar{y) + h\r. We get 

\y\'r >\y + h\'r = \yi + hi + yjc + hj.\l > \yi\l. - \hi\l. + \hic\l - \yjo\l. 

so that 

2\yr.\;>\hj.\;-\hi\: (14) 

By Corollary [HI we know that with probability greater than 1 — exp(— 6p.rfc), the operator 
S/k^^'^ satisfies property Vi{m), where m = Cp^rk/ \og{l + n/k), a and /3 being constants 
depending on p and r. We can apply Proposition [9] and we deduce from (TTT]) that 

\hi\r<(-y^\l + {P/aYf^\h\r 
We choose the constant c(p, r) in the definition of s, such that 



±)-a.„/«r)-,ji, 



hence, we get that \hiY^ < |/i|r/4, which gives that |/i/|^ < |/i7c|JI/3. We conclude from 
(HID that \yio\\. > \hic\l/3 and that 

\h\; = Ihjll + \hic\; < 4\yjc\l 

which is the announced result. ■ 
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